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Abstract 



We present a combination of heuristic and rigorous arguments indicating that 
both the pure state structure and the overlap structure of reahstic spin glasses 
should be relatively simple: in a large finite volume with coupling-independent 
boundary conditions, such as periodic, at most a pair of flip-related (or the 
appropriate number of symmetry-related in the non-Ising case) states appear, 
and the Parisi overlap distribution correspondingly exhibits at most a pair of 
(5- functions at zizqEA- This rules out the nonstandard SK picture introduced 
by us earlier, and when combined with our previous elimination of more stan- 
dard versions of the mean field picture, argues against the possibility of even 
limited versions of mean field ordering in realistic spin glasses. If broken spin 
flip symmetry should occur, this leaves open two main possibilities for order- 
ing in the spin glass phase: the droplet /scaling two-state picture, and the 
chaotic pairs many-state picture introduced by us earlier. We present scaling 
arguments which provide a possible physical basis for the latter picture, and 
discuss possible reasons behind numerical observations of more complicated 
overlap structures in finite volumes. 
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I. INTRODUCTION 



Prevalent scenarios concerning realistic spin glasses require that the nature of the 
spin glass order parameter (i.e., the Parisi overlap distribution) and the structure of the ther- 
modynamic states from which it is obtained be highly complex; see, for example, Refs. ||3|-[T9 



This complexity is asserted to be a consequence of the existence of many competing pure 
states. In previous papers [20-2^ we showed that the standard picture of this complex 



structure (including non-self-averaging of the thermodynamic overlap distribution function, 
ultrametricity of distances among all pure states for fixed coupling realization, etc.) can- 
not hold in any finite dimension. However, at the same time we presented (as a logical 
possibility) a nonstandard mean field picture in which some of these features appear in 
finite-dimensional spin glasses but in a more limited sense — i.e., in large finite volumes 
with coupling-independent boundary conditions such as periodic. In this picture, only a 
subset of all the pure states appears in each finite-volume mixed state (which varies with 
volume); those pure states along with their weights and overlaps retain some mean field 
structure. 

In this paper, however, we provide both heuristic and rigorous arguments that indicate 
the state and overlap structure in finite volumes must in fact be relatively simple. This is 
so even if there are many pure states overall. These arguments preclude the possibility of 
any type of mean field structure — even the nonstandard, limited type — for the spin glass 
phase in finite dimensions. 

Although the arguments and conclusions of this paper are applicable to fairly general 
examples of disordered systems, we will focus on the Edwards- Anderson (EA) Ising spin glass 
p6| . When there are many pure (infinite volume) states p°, it has been generally believed 
HI] that the finite volume Gibbs state pj (for a coupling configuration J' in the cube A^ of 
side L centered at the origin with, say, periodic boundary conditions) is (approximately) a 
mixture of many pure states: 

a 

and the finite volume overlap distribution Pj{q) is (approximately) the corresponding mix- 
ture of many (5-functions: 

Pj{q)^Y.^j,LW}J{q-qP) , (2) 

a, 7 

where is the overlap between the pure states a and 7: 

g7= hm |A,,|-i . (3) 



Of course, if there is only a single pair of pure states (related by a global spin flip) as in the 
droplet /scaling picture of Refs. p7|-p0[] (see also [pT| , p2| ), then for each L, Pj{q) will simply 



approximate a sum of two 5-functions at ±qEA- We will argue here that the same conclusion 
is true for the finite-volume overlap distributions even when there are many pure states. This 
is because pj will still be approximately a mixture of a single pair of pure states, although 
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now the choice of the pair will depend upon L. This scenario was previously proposed in 
Refs. [^-23] as a logical possibility that followed from the metastate approach introduced 
in those papers. Here we will argue that it is the only reasonable possibility consistent with 
many pure states, and we will also present new scaling arguments that provide a physical 
basis for it and at the same time explain its relation to the earlier and simpler two state 
droplet /scaling picture. 

It is important to note that in computing overlap distributions as in Eq. (|^), the region 
in which the computation is done should be small compared to the overall size of the system 
— i.e., the system boundaries should be far from the region of interest. The reasons for 
this were discussed at some length in the Appendix to Ref. p2|, and will be returned to in 



Section This guarantees that one is focusing on the thermodynamic states of the system 



2^ , |28[] and avoiding extraneous finite size and boundary effects. 

With this understanding, our arguments indicate that the nonstandard SK picture, in- 
troduced by us previously as the only remaining viable mean-field-like picture, is not valid in 
any dimension. The reader may wish to glance ahead at Section |^ in which this conclusion, 
one of the main results of the paper, is presented. 

The plan of the paper is as follows. In Section || we review the concept of metastates. 
In Section |T| we discuss previously proposed scenarios for the spin glass phase, including 
the newer chaotic pairs and nonstandard SK pictures. In Section |I^ we present the first of 
our main results, a theorem on the invariance of the metastate with respect to flip-related 
boundary conditions, and then discuss the consequences of the theorem. We will see why this 
result should be incompatible with any but the simplest spin glass ordering, and in particular 
how that argues against the nonstandard SK picture. In Section |V| we will provide a scaling 
basis for the chaotic pairs picture, and present one possible physical scenario under which 
it would occur. In Section [V^ we discuss, in light of our results, the question of why some 
numerical experiments appear to see a complicated overlap structure. We further discuss 
appropriate procedures for computing overlap structures in finite volumes as a means of 
extracting at least partial information on ordering in the low temperature phase. Finally, in 
Section [VI1| we present our conclusions. 



II. METASTATES 



For specificity, we will focus on the Edwards- Anderson (EA) model |26| which, on a cubic 
lattice in d dimensions, is described by the Hamiltonian 

{^■,y) 

where J denotes the set of couplings Jxy and where the brackets indicate that the sum is over 
nearest-neighbor pairs only, with the sites x,y & Z^. We will take the spins Ox to be Ising, 
i.e.. Ox = ±1; although this will affect the details of our discussion, it is unimportant for 
our main conclusions. The couplings Jxy are quenched, independent, identically distributed 
random variables; throughout the paper we will assume their common distribution to be 
symmetric about zero (and usually with the variance fixed to be one). The most common 
examples are the Gaussian and ±J distributions. The infinite-ranged version of the EA 
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model was introduced by Sherrington and Kirkpatrick and is commonly referred to as 
the SK model. 

Numerical studies of spin glass overlap structure in the EA model study finite volume 
cubes with (usually) periodic boundary conditions ||T9| . |3^j35| . A crucial property of disor- 
dered systems with many competing states is that, although particular pure states may be 
picked out by a special choice of boundary conditions depending on the disorder realization, 
such boundary conditions are not relevant for comparison to either experiments on physical 
spin glasses or to numerical simulations. In all of these cases boundary conditions are chosen 
independently of the coupling realization. 

In this paper we will therefore focus on either fixed or periodic boundary conditions 
(and their flip-related b.c.'s; see Section chosen independently of the couplings. From 
a theoretical point of view, observable properties in this situation are amenable to analysis 



by means of the metastate approach ||2T|-p5 



Metastates enable us to relate the observed behavior of a system in large but finite 
volumes with its thermodynamic properties. This relation is relatively straightforward for 
systems with few pure states or for those whose states are related by well-understood sym- 
metry transformations; but in the presence of many pure states not related by any obvious 
transformations, this relation may be subtle and complex. In these cases the metastate 
approach may be highly useful. 

One reason for this is that, in the presence of many competing pure states, a sequence 
as L — s> oo of finite- volume Gibbs measures on cubes Al with coupling- independent b.c.'s 
will generally not converge to a single limiting thermodynamic state |^6|. We call this 
phenomenon chaotic size dependence (CSD). In the metastate approach, we exploit the 
presence of CSD by replacing the study of single thermodynamic states (as is conventionally 
done) with an ensemble of (pure or mixed) thermodynamic states. This approach, based on 
an analogy to chaotic dynamical systems, enables us to construct a limiting measure, but it 
is a measure on the thermodynamic states themselves. 

This (infinite- volume) measure contains far more information than any single thermo- 
dynamic state. It has a particular usefulness in the context of the study of finite volumes 
because it carries — among other things — the following information. Suppose that there ex- 
ist many thermodynamic states in some (fixed) dimension and at some (fixed) temperature. 
Then (for example) the periodic b.c. metastate (constructed from an infinite sequence of 
finite-volume Gibbs measures on cubes with periodic boundary conditions) tells us the like- 
lihood of appearance of any specified thermodynamic state, pure or mixed, in a typical large 
volume. More precisely, it provides a probability measure for all possible 1,2, .. . ,n-point 
correlation functions contained in a box centered at the origin whose sides are sufficiently 
far from any of the boundaries so that finite size effects do not appreciably affect the result. 

Details on the construction and properties of the metastate were given in previous pa- 
pers pT|-p^. Here we simply recount some central features. The histogram, or empirical 
distribution approach, is a type of microcanonical ensemble which considers at fixed a 
sequence of volumes with specified b.c, such as periodic. The resulting sequence of finite- 
volume Gibbs states pj'^\pj'^\...,pj'^^ each is given weight A^"-*^. This "histogram" of 
finite-volume Gibbs states converges to some kj as N ^ oo. The (periodic b.c, in this 
example) metastate kj is a. probability measure on thermodynamic states F at fixed JT, and 
specifies the fraction of cube sizes that the system spends in each different (possibly mixed) 
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thermodynamic state T 

An alternative (and earlier) construction of the metastate, in which the randomness of 
the couplings is used directly to generate an ensemble of states, was provided by Aizenman 
and Wehr In this approach one considers the limiting joint distribution jj,{J',pj'^) as 
L —>■ oo. Technical details can be found in p^- p^p8| . 

It can be proved that there exists at least a jT-independent subsequence of volumes 
along which the two approaches (empirical distribution and Aizenman- Wehr) yield the same 
limiting metastate [p2|-p^. This will be important in what follows ||39[| . 

Occasionally a distinction is drawn between finite- and infinite-volume states (see, for 
example, [|19|), where it is argued that the first is more physical and the second merely 
mathematical in nature. While we have shown ||22| that the relation between the two may 
be more subtle than previously realized — at least in the case where many competing states 
are present — we also argue that the distinction drawn above is misleading. Indeed, it should 
be clear from the discussion above that the metastate approach is specifically constructed 
to consider both finite and infinite volumes together and to unify the two cases. In the next 
section, guided by this approach, we review various allowable scenarios for the EA spin glass 
phase. 



III. THE FINITE-DIMENSIONAL SPIN GLASS PHASE 

Of the possible scenarios for spin glasses at low temperature, the simplest is that spin-flip 
symmetry is not broken at positive temperatures in any dimension. This would be the case 
if there were no phase transition at all and the paramagnetic state persisted to arbitrarily 
low temperatures. It would also be the case if there were a phase transition but the EA 
order parameter qea (corresponding to the self-overlap of a pure state, i.e., qj" in Eq. (|^)) 
remained zero. Such a phase might have, e.g., single-site magnetizations equalling zero 
at low temperatures but two-spin correlation functions decaying as a power law at large 
distances. 

More likely, however, is that spin-flip symmetry is broken for d > and T < Tc{d) 0. 
In that case the simplest scenario for the low-temperature spin glass phase is the Fisher- 



Huse scaling/droplet picture [p^-pOH (see also ||3T|j3^), in which a single pair of pure states is 



present. In that case, with periodic b.c.'s, CSD is absent, and the metastate is concentrated 
on a single mixed thermodynamic state, with each of the two pure states having weight 1/2. 
This picture seems internally consistent. 

We now consider possible many-state pictures. In the standard SK picture, there is 
an overlap distribution Pj{q) that exhibits non-self- averaging (NSA) even after the ther- 
modynamic limit has been taken that is, it fluctuates with J' even though it is a 
thermodynamic quantity. Other features of this picture include ultrametricity among all 
pure state overlaps and a continuous part of P{q) (the average of Pj{q) over all J') between 
i:qEA- For details, see 

However, this standard SK picture cannot hold (in any dimension and at any tempera- 
ture) |2y] because the translation invariance of Pj{q) combined with the translation ergod- 



icity of the underlying distribution of couplings implies that Pj{q) must be self-averaged 

El- 
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This problem with the standard SK picture might sound hke a mere mathematical tech- 
nicality - for which one might hope to find a technical solution. But in fact this picture has 
an inherent conceptual fiaw - namely the basic problem that a single state pj is simply not 
a rich enough description of the L — >■ oo behavior of a thermodynamic system where CSD 
occurs. In such a picture, one is in effect replacing with a single state all of the information 
contained in an entire distribution of states, i.e., the metastate. We now consider two non- 
standard pictures, each of which arises naturally in the context of the metastate approach 
and the possible presence of CSD. 

The first of these resembles the Fisher-Huse picture in finite volumes, but has a very 
different thermodynamic structure. It is a many-state picture, but unlike in the mean-field 
picture each large volume (with periodic boundary conditions) "sees" essentially only one 
pair of states at a time (in Section |V| we discuss what it means for a finite volume to "see" 
a thermodynamic state, pure or mixed). In other words, for large L, one finds that 

pf - \pj + \p'r (5) 

where —a refers to the global spin-fiip of pure state a. Here, the pure state pair (of the in- 
finitely many present) appearing in finite volume depends chaotically on L. Unlike the 
droplet /scaling picture, this new possibility exhibits CSD with periodic b.c.'s. In this 
"chaotic pairs" picture the (periodic b.c.) metastate is dispersed over (infinitely) many 
r's, of the form F = F" = Ipj- + \p~j^ ■ The overlap distribution for each F is the same: 
Pv = ^^{(1 — Qea) + ^^{q + Qea)- Like the Fisher-Huse picture, this scenario also seems 
internally consistent. It is interesting to note that a highly disordered spin glass model 
^ , |i2[| (see also [|^) appears to display just this behavior in its ground state structure in 



sufficiently high dimension. 

The last picture we discuss is a nonstandard SK-like picture that resembles the standard 
SK picture in finite volumes, but has an altogether different thermodynamic structure. This 
picture, which also assumes infinitely many pure states, organizes them such that each 
F = Yla^jPj- '^^^ metastate kj is dispersed over many such F's, so that different F's 
again appear in different volumes, leading to CSD. Unlike the chaotic pairs picture, each 
Pr depends on F (because each F is now itself a nontrivial mixture of infinitely many pure 
states). However, the ensemble of P^s (like the single Pj of the standard SK picture) does 
not depend on J' (again because of translation invariance/ergodicity). So the conventional 
meaning of NSA — thermodynamic quantities such as the overlap distribution depending 
on J' — is replaced by a new notion: not dependence on J' but rather dependence on the 
state F within the metastate for fixed JT. Moreover, ultrametricity of overlaps among pure 
states may be present within individual F's, but not for all of the pure states taken together. 



A more detailed description of this nonstandard SK picture is given in Refs. pl|-p3 . 

Given the results of , the nonstandard SK picture is the only remaining viable mean- 
field-like picture. We have presented preliminary arguments (based on the invariance of the 
ensemble of Pr's with respect to J^; we refer the reader to Ref. |^ for details) that already 
cast some doubt on its validity, by demonstrating that the nonstandard SK picture requires 
an enormous number of constraints to be simultaneously satisfied. In the next section we 
present further arguments that more strongly rule it out as a viable possibility. 
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IV. INVARIANCE OF THE METASTATE 



The main result of this section is a theorem on the invariance of the metastate k j with 
respect to boundary conditions that are flip- related. Two (sequences of) b.c.'s are flip- 
related if, for each finite L, there is some subset of the boundary dAi whose flip transforms 
one b.c. for that L into the other. An obvious example of flip-related boundary conditions 
are periodic and antiperiodic; a second example is any two fixed boundary conditions, i.e., 
where each spin on the boundary is specified. On the other hand, periodic and fixed b.c.'s 
are not flip-related. 

In the following theorem we continue to assume that the common distribution of the 
couplings Jxy is symmetric about zero, i.e., that J^y has the same distribution as —Jxy, and 
that the external field is zero. 

Theorem. Consider two metastates constructed (at fixed, arbitrary dimension and tem- 
perature, and using either the histogram method or the Aizenman-Wehr method) using two 
different boundary conditions, with neither depending on J', on an infinite {Ln ^ oo) se- 
quence of cubes Alj^. If the two different sequences of boundary conditions are flip-related, 
then the two metastates are the same (with probability one — i.e., for almost every J'). 

Proof. We use the fact, discussed above, that along some J"- independent subsequence of 
volumes both the histogram construction of metastates and the Aizenman-Wehr construction 
have a limit, and that limit is the same. Because the Aizenman-Wehr construction averages 
over couplings "at infinity" (for details, see Refs. ||2l|- |24| , ^ ) , it rigorously follows (using 
gauge transformation arguments like those used in the proof of Theorem 3 in Ref. |^) that 
the two metastates must be the same. 

This is a striking result (despite the brevity of the proof), with important physical 
consequences. It says, for example, that the periodic b.c. metastate kj must be the same 
as the antiperiodic b.c. metastate. In fact, if one were to choose (independently of JT") 
two arbitrary sequences of periodic and antiperiodic b.c.'s, the metastates (with probability 
one) would still be identical. In other words, the metastate (and corresponding overlap 
distributions constructed from it) at fixed temperature and dimension is highly insensitive 
to boundary conditions. 

To appreciate the implications of this, consider the histogram construction of the metas- 
tate. The invariance of the metastate with respect to different sequences of periodic and 
antiperiodic b.c.'s means that the frequency of appearance (in finite volumes) of various 
thermodynamic states is (with probability one) independent of the choice of boundary con- 
ditions. Moreover, this same invariance property holds (with probability one) among any 
two sequences of fixed boundary conditions (and the fixed boundary condition of choice may 
even be allowed to vary arbitrarily along any single sequence of volumes)! It follows that, 
with respect to changes of boundary conditions, the metastate is highly robust. 

Of course, the insensitivity of the metastate with respect to changes of boundary condi- 
tions would be unsurprising if there were only a single thermodynamic state (e.g., paramag- 
netic) or a single pair of flip-related states as in the droplet picture. But it is difficult to see 
how our result can be reconciled with the presence of many thermodynamic states; indeed, 
at first glance it would appear to rule them out. 

Nevertheless, we argue below that our theorem does not rule out the existence of many 
states, but clearly puts severe constraints on the form of the metastate (and overlap dis- 
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tribution function, which also possesses this invariance property). Our heuristic conclusion 
is that, in light of this strong invariance property, any metastate constructed via coupling- 
independent b.c's can support only a very simple structure. As a consequence, we will argue 
that this theorem effectively rules out the nonstandard SK picture. 

To see that an uncountable set of pure states is not ruled out (we will discuss countably 



infinite sets below), consider the highly disordered ground state model in high dimen- 
sions, which is believed to exhibit a version of the chaotic pairs picture with uncountably 
many states. Our invariance theorem applies to this model also, and so (e.g.) the periodic 
and antiperiodic metastates must be the same, even though we might a priori expect them 
to be different. By what mechanism could this happen? The most natural possibility is 
that both the periodic and antiperiodic b.c. metastates are the same as the free b.c. metas- 
tate in which all relative signs between the different trees in the invasion forest (see 



Refs. p] , ^ for details) are equally likely. That is, each of these metastates consists of a 



uniform distribution on the ground state pairs. Given that, it doesn't seem unreasonable 
that all sorts of different b.c's should give rise to a similar uniform distribution. Indeed, 



any fixed b.c. does give a uniform distribution on all single ground states 

But this line of reasoning does appear to rule out the chaotic pairs picture with a countable 
infinity of states. In that case, of course, one can't have a uniform distribution (i.e., all 
equal, positive weights within the metastate). So now suppose that for some J' the periodic 
b.c. metastate assigns, for example, probability .39 to one pair of pure states, .28 to another, 
and so on. In other words, with periodic b.c's 39% of the finite cubes prefer pair number 1, 
28% prefer pair number 2, etc. So pair number 1 is the overall "winner" (among different 
finite volumes) in the periodic b.c. popularity vote. 

It now seems clear heuristically, though, that the popularity vote by antiperiodic b.c. 's 
should come out differently; it is unreasonable to suppose that pair number 1 be preferred by 
39% of the periodic b.c. cubes and at the same time by 39% of the antiperiodic b.c. cubes! 
The uniform distribution conclusion seems even more inevitable when one considers that 
analogous arguments also apply to pairs of arbitrarily chosen sequences of fixed boundary 
conditions. 

We conclude that consistency between our invariance theorem and the existence of (un- 
countably) many states requires, in some sense, an equal likelihood of the appearance (in 
the metastate) of all states, i.e., some sort of uniform distribution on them. Let us examine 
this further. We've already noted that different sequences of volumes with fixed b.c's — 
i.e., all volumes having plus boundary conditions, all volumes having plus on some boundary 
faces and minus on others, all volumes with each boundary spin chosen by the flip of a fair 
coin, and so on — result in the same metastate. We note for future reference that the term 
"chaotic pairs", which was chosen in reference to spin-symmetric b.c's (such as periodic) 
should be replaced here by "chaotic pure states"; i.e., in this picture, the Gibbs state in a 
typical large volume Ax, with fixed b.c's will be (approximately) a single pure state that 
varies chaotically with L. But we expect that the mixed state pj, which is the average over 
the metastate 

pjia) = J Tia)KjiT) dV , (6) 

would be the same for periodic and fixed b.c's. One can also think of this pj a.s the average 
thermodynamic state, N~^{pj^^^ + pj^^^ + . . . ,pj^''), in the limit oo. 
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Now consider the mixed boundary condition in which every fixed b.c. on the boundary 
of each is given equal weight. If there are (uncountably) many pure states present, 
then in a typical large volume one would expect to see a Gibbs state which approximates a 



continuous mixture over the pure states (cf. Possibility 3 or 4 discussed in Ref. ||2T|]). But we 



still expect that the average over the mixed b.c. metastate would be the same pj as for the 
fixed b.c. metastate, the periodic b.c. metastate, and so on. That is, the average over the 
metastate should be even more robust than the metastate itself, i.e., it should be the same 
for metastates constructed through any two sequences of (coupling-independent) b.c.'s, not 
just fiip-related ones. 

Although logically possible, it seems unreasonable that this last (mixed b.c. with all fixed 
b.c.'s given equal weight) metastate, chosen from a maximally uniform mixture of boundary 
conditions, can have anything other than a uniform distribution over the pure states. But, as 
just pointed out, this distribution should be the same for this as for all the other metastates 
under discussion. (We caution the reader that, unlike the case of the strongly disordered 



model [0, we do not have a precise sense in which this distribution can be defined to be 
uniform. For that reason, this part of the argument must be regarded as heuristic.) 

With these points in mind, we now turn to a discussion of the nonstandard SK picture, 
and other possible mixed state scenarios. 

The nonstandard SK picture requires (cf. Eq. {^) that the F's appearing in the metastate 
be of the form ^jPj^ with at least some subset of the weights Wj in each F nonzero 
and unequal. We would then have a situation like the following. With periodic b.c.'s, say, 
the fraction of Lj's for which the finite volume Gibbs state in A^,. puts (e.g.) at least 84 
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of its weight in one pair of pure states (but with that pair not specified) is 0.39. But then it 
must also be the case that with antiperiodic b.c.'s the fraction of volumes for which the finite 
volume Gibbs state puts at least 84% of its weight in some unspecified pair is still exactly 

0. 39! Moreover, the same argument must apply to any "cut" one might care to make; i.e., 
one constructs the periodic b.c. metastate and finds that x% of all finite volumes have put 
y% of their weight in z states, with z depending on the (arbitrary) choice of x and y. Then 
this must be true also for all volumes with antiperiodic b.c's; and similarly (but possibly 
separately) among all pairs of fixed b.c. states. 

Once again, the only sensible way in which this could happen would be for the selection of 
states to be relatively insensitive (in some global sense) to the choice of boundary conditions, 

1. e., for the b.c.'s to choose the states in some "democratic" fashion without favoritism so 
that pj, the average over the metastate, should be some sort of uniform mixture of the pure 
states, as before. However, unlike in the chaotic pairs picture discussed earlier, we claim 
that this cannot happen when the F's are (nontrivial) mixed states. 

The reason for this is that the metastate has a strong covariance property ||33| (see also 



2J]) in which the F's must transform in a specified way under an arbitrary finite change 
in the coupling realization. Under this finite change, the ensemble kj'(F) transforms (as 
would any probability measure) according to the change of variables F F'. Here, F' is the 
thermodynamic state with correlations {<7A)r' = {'^a^~^^^)t / {^~^^^)t) where Aif is the 
change in the Hamiltonian. 

Under this change of variables, pure states remain pure and their overlaps don't change. 
However, the weights which appear in each F will in general change, as one would expect. 
To see this, consider a particular F having a discrete pure state decomposition 
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a 



(7) 



with many nonzero weights W^- Suppose that one chooses a particular couphng J^^y and 
imposes the transformation J^y J'^y = J^y + A J. Then the weight (within V) of the 
pure state a will transform for each a as 

7 

where 

Va = {exp{(3AJa^ay))^ = cosh(/3AJ) + ( sinh(/3AJ) . (9) 

In either the droplet /scaling or the chaotic pairs picture, there are in each F only two pure 
states (depending on F in chaotic pairs), each with weight 1/2. Because all even correlations 
are the same in each pair of (flip-related) pure states, the transformation of Eq. (H) leaves 
the weights unchanged. 

However, in nonstandard SK there exist pure states within each (mixed) F with relative 
domain walls, so that they differ in at least some even correlation functions. But this then 
rules out that pj must always be a uniform mixture of the pure states, because a suitable 
change of couplings will shift the weights for each F in such a way that the distribution over 
pure states oi pj also shifts. (This reasoning can be made rigorous, but because other parts 
of the argument are heuristic, we omit a proof.) 

In other words, we argued above that the invariance of the metastate with respect to 
boundary conditions left open, as the only reasonable possibility for the presence of many 
pure states, that pj, the average over the metastate, be some sort of uniform mixture 
over the pure states. This must be true for any J (with probability one), so the weight 
distribution over all pure states must also be invariant with respect to changes in J . But 
this invariance is inconsistent with the transformation properties of the F's with respect to 
finite changes in J: if there are multiple pure states in the F's, with the pure states in 
each F not having the same even correlations (i.e., they have relative domain walls), then 
their relative weights must vary (as expected) with changes in the coupling realization. This 
leads to a contradiction, and therefore rules out not only nonstandard SK but any picture 
in which the F's are a nontrivial mixture of pure states. 

Our conclusion, based on the above combination of both rigorous results and heuristic 
arguments, is that the nonstandard SK picture cannot be valid in any dimension and at 
any temperature. More generally, the many invariances of the spin glass metastate cannot 
support any picture in which thermodynamic mixed states (other than a single flip-related 
pair) are seen in finite volumes. 

Given that the only reasonable possibilities remaining (that display broken spin flip 
symmetry) are the droplet /scaling picture and the chaotic pairs picture, we conclude that 
the overlap distribution function Pr 

Pr{q) = Y.W^W:^5{q-q^'<) (10) 

a, 7 

can at most be a pair of 5-functions at -^Qea for each F; i.e., in each finite volume the overlap 
between pure states that appear in that volume is just that pair of 5-functions. This will be 
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the case regardless of whether there is only a single pair or uncountably many pairs of pure 
states. We will discuss this further in Section but first we turn to another topic. 

In the next section we present a simple scaling approach that provides both a plausibility 
argument and also a physical starting point for understanding the "chaotic pairs" many- 
state picture introduced in Refs. ETI-EH]. It is important to note that this scaling picture 



is consistent with the Fisher-Huse droplet picture p7||30| for appropriate values of the new 
scaling exponents, but for other values can give rise to a different thermodynamic picture. 



V. A SCALING APPROACH TO THE CHAOTIC PAIRS PICTURE 

We have argued above that with periodic boundary conditions, one should see at most 
a single pair of flip-related pure states in a large volume. As already discussed, this leaves 
open the possibilities of either a single pure state (e.g., but not necessarily, a paramagnet), a 
single pair of pure states (as in the droplet picture), or the chaotic pairs many-state picture 
discussed above. We now present a simple extension of earlier scaling/droplet arguments 
P7| , |5D[ | which is consistent with this last possibility, and also provides a possible scenario for 
the spatial structure of domain wall configurations among the ground states. 

The object here is to obtain estimates on the difference in energy or free energy between 
the lowest-lying state in a fixed volume and the next higher one. The appearance at nonzero 
temperature of multiple (non-spin-fiip related) states in a single (large) volume requires 
that the energies of the lowest-lying states differ by order one. If, on the other hand, the 
"minimal" energy difference scales as some positive power of the system size, then one will see 
at most a single pair of states in any given box (with spin-symmetric boundary conditions, 
such as periodic). 

To analyze the appearance in finite volumes, and at very low temperature, of infinite 
volume pure states, as in Eq. (|l]), we will consider infinite volume ground states restricted to 
the cube of size L, with a fixed boundary condition a chosen independently of the couphngs. 
In our analysis below we will treat the boundary spins as chosen randomly and independently 
of the couplings — but for a nonrandom fixed b.c. such as plus, the same arguments go 
through with minor modifications. 

Although there may a priori be infinitely many infinite volume ground states, the number 
of distinct restrictions to the cube is finite and its logarithm should be of order L'^~^~'f' for 
some (p. The scaling exponent (with < (p < d — 1) may be understood in another way: 
the minimum number of spins on the surface of the cube that differ between two infinite 
volume ground states, whose spins disagree at (or near) the origin |^6|, should scale as L'^. 



These two states should correspondingly differ in the bulk by a number of spins of (at least) 
order L'^'^^. 

If there exists only a single pair of flip- related ground states (as argued in Refs. [p^ , p9|] ), 
then (j) = d — 1. In the highly disordered spin glass model of Refs. PT| , ^ (see also Ref. [^), 
it appears that (p = d — 1 below eight dimensions while = 3 above eight dimensions. 

Let us examine the exponent more closely. Although a priori there seems to be 
no reason to exclude the possibility that = 0, there are several arguments indicating 
otherwise. (Note also that = would saturate the possible growth rate of the number of 
distinguishable ground states in any finite volume since the logarithm of this number cannot 
exceed order L'^~^.) If = 0, then spins living in regions between domain walls would exist 
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in one-dimensional tube-like objects. It seems very unlikely that such tubes could be stable; 
i.e., eventually such a tube should encounter a fluctuation which destroys its structure. 
A second and somewhat different argument uses the fact that should be bounded from 



below by the exponent 9 introduced by Fisher and Huse [P7| , p0| , which governs the minimal 



interface free energy between different pure states on a length scale L; i.e., this minimal free 
energy is presumed to grow as . It is not difficult to see, then, that (j) > 9. However, 
it was argued in Refs. [^^^ that the inequality > is necessary in order for spin flip 
symmetry to be broken at positive temperature. In what follows we therefore always assume 
that > 0. 

Before considering the EA model itself, we first treat the much simpler case of a homo- 
geneous Ising ferromagnet with fixed b.c.'s chosen at random. First we consider the energy 
difference between the plus and minus ground states (with interface ground states temporar- 
ily not considered). Here there is no bulk energy difference, and cj) = d — 1. Because of the 
randomness of the b.c, the boundary energy difference is of order L'^'^'^. The conclusion in 
this case (see also ||2^) is that the total energy difference is also L'^^'^ and thus with 



random b.c.'s one does not see a mixture of the plus and minus states but only one of them 
(chosen by the sign of the boundary energy) chaotically changing with L. 

What about seeing interface states? Here, the appropriate bulk energy difference between 
the constant ground states and the interface states scales as L'^~^ (with the same as before) 
and so the bulk energy difference dominates the boundary energy difference. In this case the 
total energy difference between the homogeneous state and the lowest-lying interface state 
is of order L'^~^. As a result, all interface states are "invisible" in the random b.c. finite 
volume ferromagnet p3|,E7 . 



We now consider the EA Ising spin glass from this point of view. That is, we consider 
the energies of the restrictions of all infinite volume ground states to the L'^ cube centered 
at the origin. As before, we divide the energy into a bulk and a boundary part, and ask how 
the energy difference between the lowest-energy and next-lowest-energy state scales with L. 
Consider the state p* with minimum total energy (subject to the fixed boundary condition) 
and the state of next lowest energy that differs from p* near the origin. By the definition of 
0, the two states differ by at least L'^^^ spins in the bulk and by L"^ spins on the boundary. 

To estimate the energy differences between low lying states, we will separately consider 
the boundary energy coming from the couplings between a and the adjacent spins in the 
cube, and the bulk energy difference (from the remainder of the finite volume Hamiltonian) . 
If there were no bulk energies to consider, then one might expect that two states which differ 
by L'f' spins on the boundary would typically differ by an overall energy of order L'^/'^. If this 
were indeed the case for the two lowest-lying states in almost any volume, then one would 
see only one state per volume (for fixed boundary conditions). However, since one is doing 
a minimization problem which includes bulk energies as well, it is not at all obvious a priori 
that this will happen. In particular, there might be some delicate cancellation between bulk 
and boundary energies. 

We will now, however, present a specific scenario in which an explicit calculation shows 
that the lowest-lying states, in a volume with fixed boundary conditions chosen indepen- 
dently of the couplings, do indeed have an energy difference of order L'^^'^. This example is 
presented as a plausibility argument and demonstrates one way in which this can occur, but 
is not meant to imply that it can occur in only this way. 
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Consider then a scenario in which the spin at the origin belongs to a cluster, not in- 
tersected by any domain walls, whose intersection with the boundary as before is of size 
L"^. We denote that cluster Sq. Suppose further that is a general infinite volume ground 
state, and that E^i^a) is the energy — including both the boundary and bulk components 
— of Pa restricted to A^^, the L'^ cube centered at the origin. 

The energy -El (a) can therefore be written 



Er(a) = - 



E 

xe<Son9A£ 



xe9Ai,\5o 



(11) 



where the first term is the contribution from the spins in the cluster Sq on the boundary 
dAi, the second term is the surface energy contribution from all other boundary spins, and 
the final term is the energy contribution of the bulk spins. More precisely, dAi is the set 
of sites X inside with a nearest neighbor y outside dAi and Wx is the boundary spin ax 
times Jxy Eq. ( [TI]) can be rewritten as 



EL{a) = -riia)ZLV\SondAL\ + YL{a] 



(12) 



where three new variables have been introduced: r]{a) = ±1 represents the sign of the spin 
at the origin in ground state a, Zl is (approximately) a Gaussian random variable with zero 
mean and unit variance, and Y^la) depends both on the bulk energy of a and on the rest 
of the boundary spins (i.e., those not included in the first term). 

In going from Eq. (|TT]) to ([T2|) we used the fact that the boundary condition consists of 
fixed random spins, chosen independently of a. The crucial observation is that the random 
variables Zl, which arise from the random boundary conditions, are independent of the 
spectrum of the (mostly) bulk energies Yiia). We now show that, regardless of the number 
and distribution of the Yl(q;)'s as a varies, there will be no strong cancellations between the 
two terms (with probability close to one). 

Consider the ground state whose energy in Eq. (pi]) is the minimum, and also the ground 
state which has the next higher energy, and is required to have a relative spin flip with respect 
to the lowest energy state at the origin. We then have 



min ErM — min Er(a 



+1 



2ZLV\SondAL\+ Yl - Yl 



(13) 



where Yj^ and Y^ are the bulk plus remainder boundary energies of the two lowest-lying 
states with a relative spin flip at the origin. 

Since Zl and — Y^ are functions of disjoint sets of the random boundary spins, 
they are independent random variables. Hence, variances add and the effect of Yj^ — Y^ on 
the random variable 2Zl\/\Sq fl 9Al| can only be to increase the spread of its distribution. 
This allows us to conclude that with probability close to one (i.e., for most choices of the 
boundary spins) the expression on the right-hand side of Eq. (|l^) is of order (at least) 
n 5Al|, i.e., of order L*^/^. As long as </> > 0, which is part of our scenario, this growth 
with L in the spacing of the low-lying spectrum of ground states argues for the appearance 
at small positive temperature of only a single pure state in large finite volume Gibbs states 
with fixed b.c.'s (that are independent of the couplings). 
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The above argument is instructive in several respects. It demonstrates that, given the 
condition that no domain wall separates the origin from the boundary of the box, there can 
be no miraculous "conspiracy" under which bulk and boundary energies cancel out to order 
one. It does require a strong condition, namely that all domain walls, in the union of all 
symmetric differences over all ground states, do not form any closed and bounded regions. 
As stated above, this is a sufficient condition for the scaling argument given above to work, 
but we see no reason at this point why it should be a necessary condition in order for the 
conclusions to be valid. 

Nevertheless, it provides one interesting scenario for the spatial structure of ground states 
and domain walls if many states should exist. Interestingly, in the only example of which 
we're aware in which a finite dimensional spin glass apparently does possess many states 
in high dimensions — the highly disordered ground state model of Refs. Pl],ff2| — exactly 



this structure occurs! These considerations provide a possibly fruitful avenue for future 
investigations. 



VI. PURE STATES IN FINITE VOLUMES: WHAT'S GOING ON HERE? 

In this section we address what it actually means, in an operational sense, to "see" a 
pure state — which formally is an infinite volume object — inside a finite volume. We then 
use that analysis to answer a glaring question: if states and overlaps in finite volumes are 
restricted to, at most, a single pair of flip- related pure states and a pair of 5-functions at 



±qEA, respectively, then what are the many numerical simulations (e.g., |lT2| , |lqp!8| , |l9||34| , P5| ) 
and experiments ( that appear to see a more complicated state and overlap structure 

actually seeing? 

Our main point will be that pure state structure can and does manifest itself in finite 
volumes, and governs the physics at finite length scales. Conversely, observations made in 
large, finite volumes must in turn reveal the thermodynamic structure and the nature of 
ordering of the system — if sufficient care is given to the analysis of those observations. 
Indeed, were both the above statements not true, it would be difficult to see why the study 
of thermodynamics would be of any interest to physics. 

While the above assertions have long been noncontroversial for most statistical mechan- 
ical systems and models, there remains considerable confusion in the case of spin glasses 
Il50| . At least part of the problem is that reliance on the overlap structure alone can at best 
give only partial — and sometimes misleading — information on the thermodynamics of 



realistic spin glass models [g^,^,^,^. A second problem is that, as we have emphasized 
in previous papers [^,^, the connection between finite- and infinite- volume behavior may 
be more complex and subtle in spin glasses than in simpler systems. An analysis of this 
connection thus deserves more thought than a simple attempt to sever the link altogether 
between the two behaviors (as in Appendix I of So in this section we will expand on 



previous discussions p2[ to further clarify these issues. 

A thermal state, whether pure or mixed, is completely specified by the set of all of 
its (1-point, 2-point, 3-point, . . .) correlation functions. In a finite volume, a state will 
manifest itself through the appearance of a particular set of such correlations. Because 
boundary effects will invariably alter or distort (compared to an infinite- volume state) these 
correlations in some region (whose size will depend on the specifics of the Hamiltonian, 
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temperature, dimension, etc.), one must always be careful to examine them in a volume 
small enough so that these "distortion" effects are negligible. In other words, the boundary 
should be sufficiently far from the region under examination so that an accurate picture of 



the thermodynamics can be obtained ||5T 



So, for example, even in the paramagnetic state, one would measure nonzero magneti- 
zations at interior sites in the vicinity of a boundary on which all spins are fixed (e.g., to 
be +1). As the boundary moves farther out, subsequent measurements at those same sites 
would find their magnetization tending to zero. 

It is not unusual, even for comparatively simple systems, for boundary effects to penetrate 
more deeply into the interior than a shallow "boundary layer" . Consider the example of the 
two-dimensional uniform Ising ferromagnet. It is known ||5^j53[] that this system has only 
two pure states — the translationally invariant positive and negative magnetization states 
— for all < T < T^. Suppose now that on a square of side L one were to impose fixed 
boundary conditions such that all spins on the right half of the boundary are +1 and all 
spins on the left are —1. This will impose a domain wall on the system, whose maximum 
(and typical) deviation (from the vertical line passing through the origin) will scale as L^/^ 
(see Figure 1). So for all large L the system gives the appearance of having a pure state 
with a domain wall indeed, the domain wall always stays quite far from the (vertical) 
boundaries. However, if one were to look at any fixed, finite region, then as the size L of the 
square grows, the domain wall eventually moves outside the fixed region, and one would see 
only a mixture of the positive and negative translationally invariant states. The (equal, in 
this L oo) weights in the mixture correspond to the probabilities of the domain 

wall thermally fluctuating to the left or to the right of the fixed region. 

So in this example the domain wall is an artifact of the imposed boundary condition, and 
has nothing to do with any thermodynamic structure or low-temperature ordering properties 
of the system. Moreover, consideration of the spin configurations over the entire square would 
lead to incorrect conclusions about the pure state structure. This illustrates our contention 
that in order to arrive at an accurate picture of the thermodynamic structure and the nature 
of ordering of a system, one must focus attention on a fixed "window" near the origin (which 
may be arbitrarily large, but is small compared to the entire volume under consideration) . 

This conclusion is especially important when evaluating, and drawing inferences from. 



overlap functions. A more detailed discussion is given in the Appendix of Ref . p2[ , to which 



we refer the reader; here we will only reiterate an illuminating example due to van Enter 
which in turn extends an earlier example due to Huse and Fisher [^]. Consider the overlap 
distribution of an Ising antiferromagnet in two dimensions with periodic boundary condi- 
tions. For odd-sized squares the overlap is equivalent (by the obvious gauge transformation) 
to that of the ferromagnet with periodic boundary conditions, and for even-sized squares 
it is equivalent to that of the ferromagnet with antiperiodic boundary conditions. If the 
overlap distribution were computed in the full square, it would therefore oscillate between 
two different answers (one a sum of two 5-functions at plus or minus the square of M*, the 
spontaneous magnetization, and the other a continuous distribution between ±(M*)^). On 
the other hand, computing overlaps in boxes which are much smaller than the system size 
would give rise in this example to a well-defined answer — i.e., the two 5-function overlap 
distribution — which provides a more accurate picture of the nature of ordering in this 
system. 
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With these remarks in mind, we now turn to the finite-dimensional Ising EA spin glass. 
Essentially all the simulations of which we are aware compute the overlap distribution in 
the entire box. Boundary conditions are chosen independently of the couplings, and are 
usually periodic. Given our conclusion that, under these circumstances, at most a pair of 
flip-related pure states will appear in almost any flnite volume, we suspect that the overlaps 
computed over the entire box are observing domain wall effects arising solely from the 
imposed boundary conditions, rather than revealing the actual spin glass ordering. (This 
is the reason why in Section we looked only at states with relative domain walls in the 
vicinity of the origin.) 

In other words, if overlap computations were measured in "small" windows far from 
any boundary, one should flnd only a pair of 5-functions. One way to test this would be 
to flx a region at the origin, and do successive overlap computations in that flxed region 
for increasingly larger boxes with imposed periodic boundary conditions; as the boundaries 
move farther away, the overlap distribution within the fixed region should tend toward a 
pair of 5-functions . 



It is important to clear up one other misconception. It was asserted at the end of 



Section 2 in Ref. [19| that "after Ref. [34| one has to argue that the physics must change 



after some very large length scale ...in order to claim that the mean field limit is not a 
good starting point to study the realistic case of finite dimensional models...". Although, 



of course, this changeover may well occur, it is at least as likely that it doesn't |57|, and 



that nontrivial overlaps will be seen for all large L (as the uniform ferromagnet domain wall 
example illustrates). The real problem is in some sense the opposite: namely, that overlap 
computations are not being done in small enough regions to provide an accurate picture of 
spin glass ordering. 



VII. CONCLUSIONS 



In our previous papers [20-22], we showed that spin glasses may be more complex — 
in the relation between their behavior in finite and infinite volumes — than had previously 
been noted in the literature. In the present paper, we have presented arguments indicating 
that, in a different sense, spin glasses are more simple than had previously been claimed in 
much of the literature. 

Our main conclusion is that, for realistic spin glass models such as Ising Edwards- 
Anderson, any large finite volume (with say spin-symmetric b.c.'s, such as periodic, chosen 
independently of the couplings) will display at most a single pair of fiip-related pure states. 
This may correspond to either a single pair of pure states in total, as in the droplet /scaling 
picture p7|j29|j30[] , or to the "chaotic pairs" picture introduced in Ref. and elaborated 
upon in Refs. [ p^ , ^ . 

This rules out the nonstandard SK picture also introduced in Ref. [pT| and elaborated 



upon in Refs. p^ , |23[| . Combined with our earlier result pO[ ruling out the standard SK 
picture, we conclude that the thermodynamic structure and the nature of spin glass ordering, 
whether in finite or infinite volumes, cannot be mean-field-like in any dimension and at any 
temperature. 



The argument leading to this conclusion followed a theorem, presented in Section 
that the metastate for fixed JT" is invariant with respect to arbitrary choices of fiip-related 
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boundary conditions (such as periodic and antiperiodic). It was then argued that only the 
simplest pure state (and corresponding overlap) structures could be so robust [^. The 



only reasonable scenario under which (uncountably) many states could then appear is that, 
statistically, the states are insensitive to the boundary conditions. That is, the metastates 
would be generated (as in the highly disordered ground state model) through some kind of 
random fair-coin-tossing process. 

We argued in Section [V| that overlap computations should be done in small interior boxes 
(surrounded by much larger boxes where the boundary conditions are actually imposed) 
in order to remove boundary effects and get a picture of spin glass ordering that is not 
misleading. We expect that (with periodic b.c.'s) for those dimensions and temperatures 
where Qea 7^ 0, this procedure would result in a single pair of 5-functions at ±qEA [l59[ . 

We also presented in Section |V] a scaling argument that shows how a "chaotic pairs" (or 
chaotic pure states, under fixed b.c.'s) picture can arise. We provided an explicit calculation 
that supported this picture under the sufficient (but not necessary) condition that the union 
of domain walls between all pairs of pure states form no closed and bounded regions. Inter- 
estingly, exactly such a structure is present in the only example of a nontrivial short-ranged 
spin glass model known to have many ground states — i.e., the highly disordered spin glass 
model of Refs. [0,0] (see also [0). 

Given that an overlap structure computed in an entire finite volume (as opposed to that 
computed within a smaller window) might be nontrivial due only to boundary effects, it 
cannot yield definitive information on the ordering of the spin glass phase. Furthermore, 
there is no a priori reason to expect that it would display any exotic or intricate properties 
such as ultrametricity, or in general bear any particular resemblance to the mean field 
structure observed for the SK model. However, the domain walls responsible for this overlap 
structure (if present) could have an observable, although perhaps nonuniversal, effect on 
dynamics. We will explore this issue in a future paper. 
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FIGURES 



FIG. 1. A typical spin configuration in a 2d Ising ferromagnet at positive temperature below 
Tc, with fixed spin boundary conditions that are +1 on the right half of the boundary and — 1 
on the left half. The maximum (and typical) deviation of the induced domain wall from the 
vertical line through the origin is 0(L^/^). This domain wall persists on all length scales but is 
unrelated to the low-temperature ordering. It will miss a sufficiently small (o(L^/^)) window about 
the origin; examination of the order parameter inside only this window will correctly capture the 
thermodynamics. (In particular, one can examine any fixed finite region as the boundaries move 
far away.) This sketch depicts a relatively small square; for large L, the domain wall would be 
virtually indistinguishable from a straight line through the origin (on the scale L of the entire 
square), and the window would be extremely small (on that scale). 
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